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TEN EXPERIMENTS ON THE DEVELOPMENT AND TESTING OF THE 
PROGRAMED TUTORING TECHNIQUE AND ITS APPLICATION TO THE 
TEACHING OF; BEGINNING READING ARE SUMMARIZED. THE BEHAVIOR 6F 
PROFESSIONALLY UNTRAINED PERSONS IN THIS TECHNIQUE WAS > 
PROGRAMED IN AGREEMENT WITH PRINCIPLES OF LEARNING AND 



PROGRAMED INSTRUCTION FOR INDIVIDUAL TEACHING. FOUR HUNDRED 
CHILDREN, INCLUDING RETARDED CHILDREN, SLOW READERS, AND 
UNSELECTED POPULATIONS OF CHILDREN IN KINDERGARTEN AND FIRST 
GRADE, WERE TUTORED FOR PERIODS RANGING UP TO NINE SEMESTERS. 
WITH A FEW EXCEPTIONS, INCLUDING ONE "NORMAL" FIRST GRADER 
AND SEVERAL CHILDREN WITH IQ'S BELOW 50, NO TUTORED CHILD 



FAILED TO READ. PROGRAMED TUTORING WAS FOUND TO BE MOST 
SUCCESSFUL WHEN USED AS A SUPPLEMENT . TO AND COORD I NA TED ' WI TH 

regular* Classroom teaching, when used this way, it produced 

SIGNIFICANT .IMPROVEMENT ON STANDARD TESTS WHICH REQUIRED 
SIGHT-READING, COMPREHENSION, ■ AND WORD ANALYSIS. TABLES, 
FIGURES, APPENDIXES! AND REFERENCES ARE INCLUDED. THIS 
ARTICLE IS PUBLISHED IN "READING RESEARCH QUARTERLY," VOLUME 
1, NUMBER 1, FALL, 1965. (MD) 
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this is a summary report of ten experiments in which the tech- 
nique of programed tutoring* applied to the teaching of beginning 
reading, is developed and given preliminary field tests. 

7 The behavior of professionally untraiiied persons in this 
technique is programed in agreement with principles of learning 
and programed instruction for individual teaching. 

A total of 400 children were tutored in the experiments. 
They included retarded children, slow readers, and unselected 
populations of children in kindergarten and first grade, for pe- 
riods up to one semester. With the exception of one "normal” first- 
grader and some, but not all, of a small group of children with 
IQ’s below 50, no tutored children failed to read. 



tutoring is most successful when used as a supplement to. and 
coordinated with regular classroom teaching. Used in this way, it 
produced significant improvement on standard tests which re- 
quired sight-reading, comprehension, and word analysis. 



fenseifftiment prograwmde 

ceci jest un rapport r6sum6 de dix experiences au coins des- 
quelles lk technique d’enseignment programme, appliqu£e h la 
methode de donner les legons de lire est developp4e et soumise 4 
des essais preiiminaires. 

La conduite des personnes sans entrainement professionel 

This research was carried out with the support of U.S. Public 'Health Service 
Grants M-4786 (A), MH 04989. and HD00694 and the cooperation of the 
. For Wayne State Hospital and Training School and the public schools of 
New Haven,. Fort Wayne, Bloomington, and Indianapolhp, Indiana. 

, Mr. Barber took special responsibility in carrying out Experiments r, n, vr 
and later experiments; Dr. Engle for m and vn; and Mr. Kampwerth for iv 
and A major contribution to the development of Word Analysis programs 
was made by Mrs. Renie Adams. We are greatly indebted to ~ 
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dans cette technique est programme en accord avec les principes 
' d’apprendre et avec l’instruction programme pour l’enseignement 
individuel. Un total de 400 enfants ont iti entrain^ dans cette 
experience. . 

• Dans ce nombre 6taient des enfants retard£s, ceux qui 

lisent lentement, et une population non-selectee d’enfants des 
6 coles matemalles et de premiere' ann6e pour des p 4 riodes allant 
' jusqu’R un semestre. 

Avec l’exception d’un enfant de premiere ann 4 e qui 4 tait 
“normal” et d’une fraction d’un petit groupe d’enfants ayant un 
. I.Q. endessous de 50 tous ceuxqui avaient 4 t 4 entrainls ont appris 
h lire. Les donn 4 es de plusieurs experiences indiquent que l’in- 
struction programiq£e a le plus de succ&s quand elle est employee 
en supplement et en coordination avec l’enseignement r€gulier. 

. Le programme d’enseignment employe de cette manure ameiiore 
d’une maniere significative de lire i.vue, la comprehension, et 
l’anaiyse des mots. 

‘ v 

Ensenanza programada con preceptor 

este es un resumen de diez experimentos, en los cuales, la t6c- 
nica de ensenanza programada con preceptor aplicada al iniciar 
la ensenanza de la lectura, es desarrollada y comprobada en prue- 
bas practicaspreliminares. 

El entrenamiento de personas no preparadas profesional- 
mente, se planea de acuerdo con principios didacticos e instruc- 
ci6n programada para la ensenanza individual. 

En los experimentos se ensend a un total de 400 ninos. 
Elio's incluyeron ninos retardados, lectores lentos y alumnos de 
kindergarten (jardin de p&rvulos) y primer grado, no seleccio- 
nados, por un perfodo de hasta un semestre. Con la excepjjjidn de 
un nino “normal” de primer grade y algunos, no todos* de un 
pequeno grupo de ninos con cuociente intelectual inferior a 50, 
todos los ninos que recibieron instruccidn, aprenderon a leer. 

'Los informes de varios experimentos indican que la 
ensenanza programada con preceptor,|iene mas dxito cuarnjp se 
utiliza como complement) y coordinado con la ensenanza en las 
aulas. El empleo de esta forma dio residtados significativamente 
mejores en pruebas comunes, que requieren lectura visual, com- 
^ prensidn y anRlisis de palabras. 
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The goal of education should be nothing short of the fulleat possible devetoj)- 
ment of the hu m a n ., organism An experimental analysis of behavior, canrfr*' 4 
out under the advantageous .conditions of the laboratory, will contribute . 
progress toward the goal* So. will practical experiments conducted in schools 
and colleges with the help of adequate instrumentation. (B. F. Skinner, 1961, 
P* 398 ) > , 

, , ■ f ... . ; ■ • ' ' 

This paper reports a series of more or less practical experi- 
ments, conducted mostly in. schools, which have beemdirected toward 
two goals: the development of a technique that can contribute to the 
teaching of elementary reading and the development of an adequate 
instrument for research in this field. This paper is properly cons id ered 
a progress report since the project is not complete; in a sense, it is just 
beginning. It summarizes the results of ten experiments carried out in 
a state school , for retarded children, in many- classrooms of public 
school systems in Indiana, and in associated laboratory settings. Ex- 
cept for-a brief summary of the first five (Ellson, 1962), these experi- 
ments have not been published and it Is believed that several of them 
are not publishable separately. Some are experiments only in the primi- 
tive sense of tryouts; in others, a carefully planned design was aban- 
doned in midstream to permit informal investigation of obviously 
important effects that had not been anticipated in the planning. Such 
a research strategy, coupled with the relative chaos that characterizes 
the smoothest-running elementary classrooms in an effective working 
school, does not always lead to the kind of report that a journal will 
publish, especially if it is written honestly. But this strategy was ap- 
propriate to the aims of the research and to the present state of the art. 
When ground is first broken in any field of research the effects of some 
variables are so obvious that subtle statistical tests, control groups, or, 
in some, cases, even experiments are not necessary for their detection. 

The seemingly casual strategy can also be justified by the re- 
sults of some of the later experiments to be summarized below. The 
technique that has developed seems to be a highly effective device for 
teaching beginning reading, at least when used as a supplement to 
traditional classroom methods. But, possibly more important, it turns 
out to be a velatively precise and sensitive research instrument that 
greatly expands the possibility of well-controlled experimentation 
within the complex and fluid activity of the normal classroom. 

One important aspect of die developmental-research activity 
will largely be omitted in this paper: namely, the use of basic scien- 
tific theory, the many applications of the available systematized knowl- 
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edge of learning and' related processes. Throughout, it was extremely 
useful, if not absolutely necessary, to describe every observation and 
translate every description of reading and the teaching of reading that 
was encountered into the technical language of, objective' psychology. 
The key words in this language are stimulus (situation), response . 
(behavior), and reinforcement (reward, approval, feedback,, informa- 
tion). Unresolved problems are associated with the last of these terms. 

A theory of reinforcement capable of specifying the necessary and suf- 
ficient conditions for the occurrence of reinforcement is not yet avail- 
able. However, reinforcement theory , which predicts the effects of re* 
inforcement— pragmatically defined-under a variety of conditions, has 
been developed to the point of useful applicability. , \ 

• To formulate job analyses of reading and the teaching of read- 
ing in these technical terms is to build" a semantic bridge that brings 
the problems of the classroom and the knowledge of the learning lab- 
oratory much closer than they presently seem. Translated ih this way, 
not only specific problems faced by teachers but many general aims of 
teaching become, if not identical to, at least recognizable as questions 
that have been asked and' sometimes answered in the laboratory. Be- 
cause of the .complexity of the teaching situation and practical limita- 
tions on wjiat can be done in a working school, not all of these answers 
can be applied, nor are they necessarily , successful when applied. 
However* it can be affirmed that they are extremely useful in planning 
teaching strategies in schema and detail, and in suggesting solutions * 
to the continual stream of concrete problems that arise when one at- 
tempts to teach on a realistic scale. This semantic device for establish- 
ing communication between the laboratory and the field is no doubt 
more easily applied qnd perhaps more effective in programed tutoring 
than it can be for the classroom teacher. y 

In what follows, the procedures ind some of the formal results 
often experiment* are summarized. An attempt is made to outline the 
findings derived (with varying degrees of certainty ) from this research. 
Finally, the technique of programed tutoring that has evolved to date 
on the basis of experimental results and more subtle information of 
which there is no explicit physical or psychological record is described. 

Reading is a complex activity that, as a minimum, Includes * 
oral or sight-riding, phonics, and comprehension. Among these, oral 
reading reasonably comes first both in a teaching and a research pro-, 
gram because of its relative psychological simplicity. Phonic analysis 
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id synthesis is clearly not necessary at the :start, and the comprehen- 
sion of the meanings of visually presented words or of die sentences 
in which they occur cannot precede their identification. The latter is 
most easily indicated by an oral response. For these and other reasons, 
the investigation began with the teaching of oral reading of single 
words. The first limited goal' was the automation of sight-reading 
vocabulary drill for retarded children. It was hoped that some very 
dedicated teachers- would be relieved of a deadly, unrewarding 
chore. 

> • Automation of the teaching of Oral reading-poses one techni- 

cal problem that is not critical in most other work with programed 
instruction and teaching machines. Although machines can provide 
most of the basic conditions necessary to produce learning, they do 
hot listen well; they cannot distinguish (and thus differentially rein- 
force), correct and incorrect oral responses with the proficiency re- 
quired for teaching purposes. Consequently, it was necessary to utilize 
at. least one human component in conjunction with the teaching ma- 
chine to make this discrimination. As a matter of convenience, this 
necessary/ person was also given more extensive responsibilities, so 
that he was properly called a tutor. His behavior was otherwise fully 
determined by the, programs so that he was appropriately called a. pro- 
gramed tutor and our technique, programed tutoring. 



EXPERIMENT I 

- Acquisition of sight-reading vocabulary by retarded 

children using pictures as prompt-stimuli 

* 1 ' . , v # « • 

Subjects were 38 retardates, residents of the Fort Wayne State 
School, meap CA 16, range ir to 40; mean IQ 54, range 25-74, dis- 
tributed randomly to e*^rin(ental and control groups. Apparatus con- 
sistedof a wooden screen, with an opening in which a word or a word 
and a picture could be exposed, which separated experimenter and 
subject. Lights for reinforcement were mounted at the top. The learn- 
ing material was chosen from a list of 82 words selected from the 1500- 
word reading vocabulary for the primary grades prepared by Gates 
(i935) hi which each word was paired with a picture which the chil- 
dren named with that word only. A 150-word general reading vocabu- 
lary test was constructed by selecting every, tenth word from the same 
Gates list ah^anged in order of frequency, with words in the learning 
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material excluded. -This test was administered twice to both groups 
and the program presented below was used. 

The Picture Program summarized below and the Sight-read- 
ing Program presented later are branched rather than linear. Since 
single branches are repeated witti successive units of material, they are 
appropriately called cycled branch programs, they differ from most 
programs 1 in that they do not include special organization of a body 
of subject matter, but are recursive teaching procedures adapted to. 
sequences of material hi units defined primarily by form, e.g., words 

and sentences, * 

.! 

The picture program 

■ Presentation of the program was preceded by an introductory 
statement describing the procedure in simple words and emphasizing 
that a brief flash of the lights at the top of the screen indicated that the 
child had read the word cortecdy. 



Step i: The tutor shows a word. If the learner's oral response is cor- 
rect, the tutor reinforces (by flashing a light) and proceeds to the next 
/ word, Step i. If incorrect, the tutor proceeds to Step 2. 

Step 2: The tutor shows the same word and a corresponding picture.' 
If the learner’s oral response is correct, the tutor proceeds to Step 3. If 
incorrect, the tutor names the picture (word) correctly and the learner 
repeats. The tutor then proceeds to Step 3. 

Step 3: The tutor removes the picture, leaving die word visible, and 
'■ the learner is asked to repeat it once more. If the oral response is correct, 

• the tutor reinforces and' proceeds to the next word. Step i..If incorrect, 
the tutor names the word correctly and the learner repeats. The tutor 
then proceeds to the next word, Step.i. ^ 

Following an appropriate introduction, this program was ap- 
plied successively to all words in the learning material on Trials 1 and 
5. On Trials a, 3, and 4, it was followed only for words not known , i.e., 
not correctly read in Step i on any previous trial. Trial 6, similar to 
Trials 1 and 5, was given one month after Trial 5 as a retention 
test . 



group on Step 1 in Trials 1, 5, and 6 are shown ip Table 1. 



1. See, jfoi example, Lumsdaine end Glaser (1960) and Hansen, Christman, and 

Seidel (1963). 
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Table i Learning and 
retention, experimental 
group 



Table 2 Vocabulaty test 
(Not practiced during learning 
trials) 





Meant 


Trialz 


20.9 


Trials 


32.7 


Gain 


11.8* 


Trial 6 


27.7 


Lon 


5.0(43%) 



'"•** • A’ 


Experimental otoup Control group 


Pre*test 


'17.0 


v 17.9 


Post-test 


24.1 


20.9 


Gain 


7.1 


2.8. 


Pm* 


<•05 


*<20 



L * P < <oi 



Note.— The difference in gain for the two 
groups was significant at the <.ao level. 
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3® ; 7 minutes, giving a mean learning rate pver this short period of 
approximately 19 Words per hour. Retention after one month was 
hot remarkable. : \ 

ftre- and post-test scores on the general reading vocabulary 
test for experimental and control groups are shown in Table a. 

The results for the experimental group are interesting in that 
.they show significant improvement in a performance not practiced, 
which might be described as a “therapeutic” effect. They also suggest 
that some of the 'Teaming” shown in Table i may have been relearn- 
ing or latent learning (all of the subjects had some prior school back- 
ground ). These suggestions were followed up in later investigations. 
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EXPERIMENT II 

• The use of retarded tutors 

’ * -■-* * . * ‘ • - . 

Experiment it was an informal test of the feasibility of using 
retarded children as tutors. Two residents of the State School were 
taught without difficulty to adii^inister the Picturb Program used in 
Experiment 1. Less than two hours was required for tr ainin g in each 
case. These tutors were characterized as follows: Tutor A: CA, 14; IQ, 
71. Tutor B : CA, 17; JQ, 58. \ V v 

Tutor A taught one retarded child seven words; Tutor B taught 
four retarded children a mean of 28 words. The average rate of ac- 
quisition (23 words per’ horn;) was slightly higher than that attained 
in Experiment 1 in which the tutor was a college graduate. 

Whether or not the results obtained in Experiments 1 and n 
represent true initial learning or the reinstatement of prior learning. 
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gram form is a feasible technique fpr/increasing the reading vocabu- 
lary. of retarded children. However, except for special purposes, this 
program has been abandoned. It will be noted that the pictures were 
used as stimuli, not as illustrations; as'stimuli, they are effective only 
if the response to them is uniform. The picture o£ a robin, for exam- 
ple, cannot be used since it evokes at least two verbal responses with 
non-negligible frequency, e.g., “bird" and “robin”. Less than 20 per cent 
of the words in the Gates list of 1500 most frequent words can be pic- 
tured with sufficient nonambiguity <or this technique, and these are 
not the most useful in a sight-reading vocabulary. There is also some 

in teaching these 



cannot be pictured adequately. 

V 



EXPERIMENT III 



in a sentence 

context was developed and given a preliminary test with three groups 
of children. For this and several experiments that followed, the read- 
ing material for die program was printed in primary type on a scroll 
and presented by a “teaching machine” designed to expose either one. 
sentence, alone or one sentence and the words of that sentence in 
random order. The program, preceded by appropriate instructions, was 
applied to consecutive sentences in a story designed for adult begin- 
ning readers. ' « 



Step xi The machine shows the sentence. If the sentence is read 
correctly orally, the tutor reinforces and proceeds to the next sentence, 
Step 1. If the .sentence is not read or is read incorrectly (error in reading 
any word) the tutor proceeds to Step 2. ' 

. ' ’ ... ' > 

Step 2: The machine shows the sentence and, below this, the words 
of the sentence in a random order A. The tutor reads the sentence, then 
points to the words below one at a time in the given random order. If all 
words are read correctly, the tutor reinforces each word as it is read and 



child, who repeats it, and then proceeds to the next word. After the last 
word, the tutor proceeds to Step 3. 
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Step 3: The machine shows the sentence. If the child reads the sen- 
tence conrectly, the tutor reinforces and proceeds to the next sentence, 
btep 1. If the sentence is not read, or any word is read incorrectly, the 
tutor proceeds to Step 4. 3 






Step 4:- The machine shows the sentence. The tutor reads the sen- 
tence, then, leaving it visible, names the words of that sentence, one at 
a time, in a random order B (different from that in Step 2), the learner 
pointing as the tutor reac^. If all words are pointed to correctly, the tutor * 
reinforces and proceeds to Step 5. If any word Is not indicated correctly, 

. Jhe tutor points correctly and the learner then points. After thfe last word £ 
the tutor proceeds to Step 5. 

^1 A t ~ . < ^ ^ jtllG sentence. If the sentence is read cor- 

rectty the tutor reinforces and proceeds to the next sentence. Step 1. If 
there is error in any word, the tutor reads the word orally and the learner 
repeats: A^ter the last word the tutor proceeds to the next sentence. 
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Sessions began either with the first sentence in the learning 
material or, after progress had been made, with the third sentence 
preceding die first on which an error had been made in the preceding 
session. Eight half-hour sessions were given, two per week for four 
weeks. At the beginning of each session, on a ninth test session, and 
On the .retention test session one month later, a reading recall -test 
was administered in which all of the 57 words in the learning material, 
printed in columns in primary type, were presented. Data in Table 3 
and Figure 1 are based on these tests. . - \ 

Three groups of four subjects each; a] normal first-grade 
children, b] slow readers in the first grade, and c] retardates sim- 
ilar to those in Experiment 1, were taught under the conditions de- 

s scribed above. All of the ret - 

but were considered to be 
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groups, gains during the learning, and retention over the following 
month are summarized in Table 3. Mean rates of learning were ap- 



Table 3 CA, IQ, words learned, and one 
month retention 



% K ’ 

-,Grou$ 


Mean 

CA 


Mean 

IQ. 


. Mean 

Ovffain 


Mean % 
retention 


Normal 


6-4 


108 


30.5 


94 - 


Slow 


7-1 


93 


20.0 


92 


Retarded . 


18-1 


54 


.19.5 


90 
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and 7,5 for the normals. 



groups 




tests, mean gains for the normal, slow, and retarded groups respec- 
tively, were 7.5, 2.6, and —0.2 words. Retention was not computed 
for the/ control groups because of loss of subjects due to vacation 
schedules. 

The initial rates of increase in vocabulary for all experimen- 
tal groups were similar (Figure iA), but individual curves for the 
normals showed Relatively constant rates overall or positive accelera- 
tion (Figure iB), while most of those for the retailed' children and 
slow readers (Figures iC and iD) showed decreasing rates. - This 




in leam- 




exposed to more schooling than the first graders, it seemed possible 
that re-learning rather than initial learning was involved and that the 
decrease in rate indicated an approach to the limit of a previously ac- 
quired reading vocabulary. It was also possible that the difficulty was 
due to tiie nature Of the program or tiie conditions under which it was 
administered. In particular, the program used in this experiment re- 
sulted in much repetition of material already learned, and the half- 
hour tutoring sessions - seemed excessively long. Both conditions were 
modified in, lqter experiments. 

7 "Therapeutic” effects of the training, indicated by the reading 
of words not taught, were negligible (Table 4) except for one subject 
in the stow-reader group whose score increased by 59 between pre-test 
and retention test. Since the test was a id per cent sample of the Gates 
list of 1500 words, a very large gain in reading vocabulary was 
indicated. , ; 7 7 

v Table 4 Mean gain in words \ 

* ; read correctly on general vocabu- 
lary test (Not practiced in ex- > • 

' pertinent)' 



\ 



Group 


Pre-test to 
post-test 


Pre-tesito 
one month 
retention 
test 
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EXPERIMENT IV 



Comparison of classroom and programed 
tutoring techniques ' * . 



. ■- . i * 

Four groups of 16 retarded children, similar to those taking 
part in Experiments i to m, were tested for a] vocabulary learned 
and b] comprehension, before and after six half-hour teaching ses- 
sions distributed through one and a half weeks. The conditions dis- 
tinguishing the four groups follow: 



GROUP 



CONDITION 

Program: Taught individually with the Sight-read- 

ing Program. 

Classroom: Taught the, same material by standard 

classroom procedures in groups of eight. 

Alternation: Taught in alternate sessions with pro- 
gram and classroom procedures. 

Control: No training between tests. 



• V .. . . . \ 

All groups were given two tests both before and after the training 
period ; a] a test of the total reading vocabulary that appeared in the 
learning, material, and b] a test of comprehension that involved oral 
questions about the meanings of new sentences constructed from 
words in the learning material. 

Results expressed as gain in vocabulary and comprehension 
test scores are shown in Table 5. . 



Table 5 Mean gain in practiced vocabu- 
lary and Comprehension test scores 



Group 


Vocabulary 

gain 


Comprthention 
-■ gain 


Program 


32.9 


.9 


Clut 


18.1 


1.5 


Alternation 


’37.6 


4.1 


Control 


6.6 


U 



lary gains were significant at the .05 level: Control vs. Program, Con- 
trol vs. Alternation^ Class vs. Alternation. No differences were sig- 
nificant for comprehension gains. 
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EXPERIMENT V 



and program procedures 

This study extended Experiment iv for an additional six ses- 
sions, giving each subject a total of four sessions per week for three 
weeks. Three methods of combining the program and classroom pro?* 
cedures were compared. The tests were the same as those in Experi- 
ment iv but were presented again as an additional post-test after the 
twelfth session. Experimental conditions for the four groups were 
as follows: 



GROUP 

P-C ' 
C-P 



CONDITION 



gram followed by six sessions in the classroom. 
Six sessions in the classroom followed by six 



A . Twelve sessions in which classroom and pro- 
gramed tutoring were alternated. 

Control No training between tests. 

, * • *- . 

/ Results expressed as gains in reading vocabulary and com- 



Table 6 Mean 'gains in practiced vo- 
cabulary and comprehension test scores 



Group 


Vocabulary 


Comprehcntion 


P-C 


39.0 


3.8 


C-P 


* 37.6 -v 


3.7 


A 


57.2 


6.6 


Control 


12.6 

1 - 1 


1.4 



All experimental groups gained significantly more in vocabu- 
lary scores than did the control group. The mean rate of acquiring 
new reading vocabulary by the alternation procedure was approxi- 
mately nine words per hour of instruction. Mean gains in vocabu- 
lary were statistically significant for all except the control group; 
the difference in vocabulary gain between Groups A and C-P was. 
significant 'at the .05 level. Other differences are not statistically 
significant. ' 
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Improvement in comprehension was statistically significant 
for Group A only, but the gain was not significantly greater than that 
of the control group. There were no significant differences between 
..groups for comprehension scores. Poor comprehension under the con- 
ditions of this experiment is understandable, since at the lime :of the 
final test few children could read mo*e than 50 pet cent of the words 
in the comprehension test ihaterial. 

Experience with the Sight-reading Program so far has indi- 
cated one obvious defect: as a learner’s vocabulary increased, he often 
read entire sentences with perhaps a single error. In the Sight-reading 
Program, as presented (see Experiment in), such an error leads to 
Step 2, which requires practice on all of the words in the sentence, in 
eluding those read correctly on the preceding test step. Such extensive 
digressions appeared to frustrate some children at a very early stage of * 
vocabulary acquisition, and this undesirable effect increased with 
progress. Consequently, the Sight-reading Program was modified to 
minimize repetition of material already known. In later forms of the 
program the teaching procedures in Steps 2 and 4 were applied only 
to those words not read correctly on the preceding test steps. This 
change, based on purely practical considerations, was supported 
strongly by the results of the following study. \ 






EXPERIMENT VI 

Investigation of the optimal proportion of 
reinforcement 




in 



the laboratory to the techniques of programed, instruction, Skinner 




and errors minimized: “By making each successive step as small, as 
possible the-frequency of reinforcement can be raised to a maximum, 
while the possibly aversive consequences of being wrong are reduced to 
a minimum.” But in our program and, in fact, in any branched pro- 
gram in which information or teaching steps are presented only in case 
of error on test steps., the principle implied here cannot be followed to 
its logical conclusion since 100 per cent reinforcement would preclude 
the presentation of any new information, in which case, nothing could 
be learned. But, if it is assumed that reinforcement should be maxi- 
mized short of this extreme, the practical question" arises: what is the 
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optimum proportion of reinforcement? Presumably it is near, but less 
thin i. Experiment vi was run to obtain an empirical answer to this 
question. Rates of acquisition weredetermined for four proportions of 
reinforcement, ranging from .05 to .95. 

* A Paired Associates Program, similar to the Picture Program 
; of Experiment ! except oral prompts replaced pictures as stimuli to 
evoke the correct oral response, was used. The apparatus or "teaching 
machine” was also simitar* It was composed of a wooden screen in 
which words were exposed and on which a light was mounted behind 
a frosted glass panel. Subjects were told at the beginning of the ex- 
periment that the light meant they had read a word correctly; during 
training trials "the light was turned on briefly after correct responses 
in Step 1 only. 

Each of the four groups was given four training trials: 20 
words were presented in each, followed by a test consisting of all of 
the words learned on Trials 1 to 4. The proportion of reinforcement 
on training trials was maintained near the required level for each 
group by controlling the proportion of “known” and ^unknown” words 
included in the list of 20. Note that the proportion of reinforcement on 
a given trial is equivalent to the proportion of known words, i.e., words 
read correctly (and thus rekiforced) on Step 1. This proportion was 
held approximately constant for each subject: on the first trial by se- 
lecting words that he had and had npt read correctly on a pre-test, 
and on'Trials 2, 3, and 4 by replacing excess words read correctly on 
the preceding trials by other words not read correctly on the pre-test. 

A total of 41 older retardates, similar to those in earlier ex- ' 
perinjents, were assigned to four groups, each trained with a different 
* proportion of reinforcement : .05, .35, -65, and .95. Results, which ap- 
pear graphically in Figure 2 and numerically in Table 7, show an 



number of wprdsr learned as measured by performance on the test trial. 

• • ‘ . ... ^ , : • . ; 

Table . 7 Proportion of reinforcement and words learned 
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Inttndtd 
proportion of 
rnnforcomont 


Actual moan 
" proportion of t 
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Mean word* 
learned 
trial* 2-4 


Mean word* 
learned * 
trial* 
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. *.05 
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10 



5 ? 



5 35 65 05 

A % REINFORCEMENT (INTENDED) 

**0. a; Womb learned and correctly read on Trial 5 as a func- 
tion of proportion of reinforcement Experiment *1. 



nificant; and t-tests showed all inter-group differences except for the 
adjacent pairs, i-a and 2-3, to be significant at the .01 level. . 

The inverse relationship between proportion of reinforce- 



expectation, although it was consistent with modifications introduced 
in the ffight-feading Program on the basis of purely practical considera- 
tions. 



time spent in practice on known material.' It was also consistent with 
the notion that drill is not an efficient teaching method. 

The plan of this eiqieriment was defective. Since the test trials 
included Only words learned on previous trials, they were not cbm- 



with' better controlled conditions, although considerations not dis- 



results. 



V 



experiment vu 



V 



a revision 

of the Sight-reading Program with particular concern for the feasibil- 
ity of its continued use over an extended period of time. This tryout 
was also designed to permit comparison of the effectiveness of ma- 
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chine and textbook forms of the program for teaching sight-reading 
■ to slow readers in the public schools and to two groups of institu- 
tionalized retarded children differing in age and related background. 
The experiment was originally planned for one semester, comparing 
only older retardates and slow readers. However, the retardates pro- 
gressed extremely rapidly (according to a presumably justifiable com- 
parison of pre-test and performance data, they learned” at a mean 
rate of 57 new words per hour of practice). Consequently, the experi- 
ment was repeated during the second semester with a group of younger 
retardates having less prior school experience. Results in this replica- 
tion were more in accord with expectations for retarded children. 

The material for the machine form of the program was printed 
on a paper scroll and presented one sentence at a time by a "teaching 
. machine ” similar to that used in Experiment m. Pictures appearing 
in the text were mounted oh cards and hand-placed at appropriate 
times above the opening in whicl^ the sentence appeared. The ma- 
terial for the textbook form of the program was arranged in booklets, 
each containing six to eight sentences on a comrhon theme and con- 
stituting a "stor/!” Single sentences were reproduced at the bottom of 
otherwise blank cover pages which were graduated in length so that 
■ when the booklet was opened an entire stpry appeared, one sentence 
per line. Concealed beneath each cover page were five pages of the 
same length containing the materials for an eight-step operational 
program designed to teach words of the sentence not read correctly 
from the cover page. These materials included the sentence with and 
without an illustrative picture, the words of the sentence in a random 
order, and the words under small flaps for individual exposure. A "re- 
inforcement box,” used with both forms of the program, contained 
lights, separately controlled by concealed pushbuttons, behind trans- 
lucent white and green panels. The children were told that the white 
light would appear when they read an entire sentence correctly and the 
green light when they read a single word correctly. » 

The operational program was similar to the Sight-reading 
Program described in the report of . Experiment m, but differed in sev- 
eral significant details: it contained eight steps in which 3, 5, and 7 
, were teaching steps; the others were test steps^similar to Step 1 in the 
earlier program. Two of these, 2 and 4, were "picture-prompted” tests 
ini which a relevant illustration was presented with the sentence to be 
. toad. Steps 1, 6, and 8 were unprompted tests in which the sentence 
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was presented alone. Step 3 utilized the very common teaching device 
which in the laboratory is called the Paired Associates Method. Words 
-not read. correctly on the prompted test, Step 2, were pointed to singly. 
Kibe learner read the word correctly, the green light was flashed; if 
^rfot, the word was pronounced by the tutor and the learner was re- 
quired to pronounce it before proceeding. This' step was introduced 
primarily for children who were able to read with some fluency. For 
* th®tn it served to quickly reinstate a temporarily forgotten word 'With 
a minimum of interruption to the flow of reading; For children still 
reading slowty this step was likely not to be sufficient, so that they 
continued through teaching steps 5 and 7 (similar to Steps 2 and 4 
in the Sight-reading Program of Experiment m). As indicated above, 
correct reading of a sentence on a test step was reinforced with a 
< white light; correct reading of a word on a teaching step by a green 
light. 

The reading material, which may be called the content 'pro- 
gram to distinguish it from the operational program described above, 
was adapted from' Reader One, A Day with the Brawn Family, and 
Reader Two, Making a Good Living, from the Home and Family Life 
Series (Bright & Mitchell, 1949). The selection contained 105 differ- 
ent words -and a total of 327 running words. Sentence length ranged 
from four to ten words with a mean of 6.7. Each sentence was accom- 
panied by a. picture chosen from the original text material; in several 
instances, the same illustration was used with more than one sentence. 

. The program was administered to experimental groups during 
20-minute sessions twice weekly for 12 weeks. The tutoring was 
carried out by two women students, college sophomores who were pre- 
paring for elementary teaching but who had had no teaching experi- 
ence. Control groups were given pre- and post-tests at the same time 
^ as the experimented groups but received no tutoring. 

) Performance was measured in terms of the number of differ- 

ent new words included in sentences read correctly on Step 1 during 
tutoring sessions, and in terms of scores on three tests.: Test.j: a gen- 
eral reading vocabulary test constructed as a 10 per cent sample of 
th&Gates list of 1500 words; Test n : a list of the- 105 words included 
in the content program ; and Test m: a list of the 49 sentences in the 
same material All were scored in terms of the number of different 
words read correctly. All were used as pre- and post-tests. Test in was 
also administered once per week during tutoring sessions. 
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Six groups of 16 childreneach were selected from states and 
public schools as follows : 

group OR Older retardates chosen^ randomly from’ advanced aca- 
demic classes (approximately third grade level) in the Training School 
at the Fort Wayne State School for Retarded, Children. Mean CA 16-1 
(Range 12-19); Mean IQ 54 (Range 41-80). 

group YR Younger retardates chosen from\pre-academic classes 
(below first grade level) in the Training School. These children were 
chosen on the basis of teachers’ judgments that their spoken language 
was intelligible and that they could understand the material in the con- 
tent program if it were read to them. Mean CA 13-4 (Range n-15); 
Mean IQ 43 (Range 30-56). 

group SR-i Slow readers randomly selected from pre-first grade 
reading-teadihess* classes in an elementary, school of the Fort Whyne 
public schools. The population from which this group was selected con- 

. V* n .1 f j 1 j 1 1 * h « A - .. 



as indicated by teachers’ judgments ‘and reading-readiness tests: Mean 
CA 6-2 (Range 5-8 to 7-3); Mean IQ 91 (Range 7&-1 05). 

group SR- 2 A second group of slow readers randomly selected from 
the same population as SR-i. This group served as a control group 
(Group SRC) during the Fall semester and was* tutored as an experimen- 
tal group (Group SR-2) diving the following Spring semester. Mean CA 



control group ORC A second group selected as was OR. Mean CA 
16-1 (Range 13-24); Mean IQ 57 (Range 47-81 ). 

control group SRC The children in Group SR-2, used as a control 
during the Fall. Mean CA 6-4 (Range 5-8 to 7-4); IQ’s as above. 

Reading performance scores on the three pre-tests were zero 
for all subjects except those in the OR and ORC groups. For the OR 
group, mean scores on pre-tests 1, n, and m respectively were 29, 42, 
and 24; for the ORC group, 27, 34, and 16. 

Performance during tutoring and gains from pre-test to post- 
test are summarized in Table 8. In this table, N is the number of sub- 
jects wfib remained in the experiment through the post-tests; n > o 
refers to the number who showed gains of 1 or more on given tests. It 
is evident from the performance data given here and in the figures to 
follow that significant progress was made in reading “new’* material 
by all groups during the tutoring process. However, the extremely rapid 
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gains made by the OR group, especially when expressed as rate of ac- 
quisition, led to the suspicion that the improvement represented not so 
much the acquisition of new vocabulary as reinstatement of prior 
learning or latent learning. The fact that all of the retardates had had 
prior schooling, often several years, supported this interpretation. Be- 
cause of this, and since the concern here was primarily with the ef- 



there was little more to say about the OR group. 

Table 8 











Grouve 














Experimental 




Control 




N • 


OR 


Y R 


SR-i 


5R*2 


ORC 


SRC 




xo« 


7 


12 


*4 


15 


*4 


Total gain 

during 

tutoring 


Mean 

Range 


649 

29 to 105 


38.9 
4 to 105 


74.8 

48 to 105 


82.1 

56 to 105 

* 


— 




Rate: - . 
gain pert 
session* 


Mean 

Range 
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19.1 

4.0 to 53.0 


2.1 

.2 to 7.0 


2.1 to 4.8 


4.6 , - 

2.4 to 8.8 

P* • * /. f 
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Gain on . 

Tests 

Pre-Post" 


Mean 
Range 
n> 0 ' 


74.? 

-r\ to 20 
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O ’ 


, .2 
0to2 
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3.1 

OtolO 

10 


u* 

-6 to 12 

r . « 
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, ' 4 
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Testzz 

Pre^Post 

Gain on. 

Testm 

Pre-Post 


Mean 
Range 
n > 0 

Mean 
Range 
n> 0 


46.5 
ll to 77 
10 \ " 

71.7 Y 
23 to 103 

10 . 


5.0 

Otoll 

7.N- 

0 to 22 
5 


'15.3 

0to27 

11 

19.0 
6 to 36 
12 


14.9 

Dto45 

13 

2S.1 
0to64 
13 , 


5.4* 

-2 to 15 
12 

3.5* 

-2 to 15 
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0 * 
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Test ii Gain X zoo 
Total Gain ‘ 


72% 


13% 


20% 


18% 


* 


mm* ^ 



l woros m me program on Session 1 are not Included. 

6 program 1 * eM * on> 0,1 t®*** sessions present or sessions before completion of 

• Difference, OR vs. ORC, Test i:* r t ss x.ga (p > . 05 ) 1 

Difference, OR vs. ORC, Test n: t = 7 . 9 a (p < . 001 ) 

Difference, OR v«. ORC, Test m: t = 8.30 (p < . 001 ) 



on all of the post-tests was markedly less than that read during tutor- 
ing- This was to be expected in the case of Test i because of the small 
overlap between the tutored and tested vocabulary, but the decrease 
was also large for Tests n and m. This indicates that, under the con- 
ditions of this experiment, retention or transfer from the tutoring 
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situation is limited! This is especially the case for the YR group which 
agrees with prestos comparisons of normal and retarded childrens 
(Kirk 0 c Johnson, 1951). However,- the relatively close relationship 
between totel gain: during tutoring and the proportion of transfer to 
thp tests suggests that other factors may be involved. 

An analysis of variance showed differences between experi- 
mental groups in rate of acquisition during' tutoring to be significant 
at the .001 level, but no significant effect of form (text vs. machine) 
and no significant interaction, was found. Mean differences in rate 
were significant for all pairs of groups except YR and SR-i. 

Individual cumulative acquisition curves for all subjects who 
completed the training and post-tests are presented in Figure 3. The 
detailed picture concurs with the averaged data given above. Both 
initial reading vocabulary and rate of acquisition were markedly 
greater for the older retardates than for the remaining groups. The 
yourtger retardates learned more slowly and the performance of the 
slow readers fell between those of the two retarded groups. Variability 
in rate was relatively greater for the retarded than for the public school 
children. - \ . 

Individual curves indicate a relatively constant rate of ac- 
quisition throughout the period of tutoring for all but the YR group. 
Two of the children in this group, whose IQ's were 56 and 34, showed 
a learning pattern similar to that of the median slow readers (and of 
normal children in later experiments). However, the remaining five, 
whose IQ's were 56, 43, 43, 29, and 30, ceased to improve after an 
initial period of apparently normal acquisition. Detailed records for 
these children showed a stereotyped performance during the terminal 
. period of no progress : each child read the same sentences and made 
the same errors repeatedly. 



, An important finding in this experiment from the practical 
point of view was the apparent effectiveness of the programed tutoring 
technique for the teaching of sight-reading to many, children who 



commonly have difficulty in beginning reading. However, it clearly 
failed with a number of the more severely retarded children and the 



transfer to test situations, differing only slightly from the tutoring 
v situation, was less than expected. Further research will be necessary 
to show, whether modifications of the technique or the conditions 
under which it is applied can extend the range of children with whom 
it is effective or can increase the transfer of what is learned. 
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big. 3. New words read during tutoring: individual curves. Experiment vn. 
EXPERIMENT VIII 



The primary purpose here was to try out three programs de- 

3, and 






programs, were tested under several conditions with children of a 
wide range of intelligence and reading-readiness as indicated by tests 
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and teachers’ judgments . The effectiveness of the combination of pro- 
grams was compared .with that of classroom teaching. 

- The comprehension programs were constructed on the basis 



hensiori behavior, or, for that matter, comprehension of any verbal 
stimulus material except possibly that designed to evoke an emotional 
response, has a\ compliance, b] semantic or referential, ^pd c] 
logical Or combinatorial components. To demonstrate reading compre-.. 
hension the child must be able to a] obey printed instructions and an- 
swer printed questions, b] relate printed words and sentences to 
objects. £nd situations (or verbal and non-verbal representations of 
thorn), and c] prpduce of identify conclusions drawn or extrapolated 
’ from combinations of printed sentences. 'Hie three comprehension 



* 



of these components. •• t 

Each of these programs began with material that \vas re- 
viewed, when necessary, by use of the Sight-reading Program. This 
sight-reading was followed by further test and teaching steps which 
required comprehension. The Instruction Comprehension Program 
presented one-page units, each containing a picture with two or more 
objects, a sentence describing the picture, and a second instruction- 
sentence or question which could be responded to appropriately by 
pointing to one of the objects. The Question Comprehension Program 



answered on the basis of information in the picture. Answers were 
first given orally and then, after removal of a covering flap, by pointing 
to and reading the correct one of three printed answers. The State- 



could not be obtained from the accompanying illustration, but only 
from a statement that preceded the question. 

The material taught by the tutoring procedure in this experi- 



Sight-reading Program. Each story was followed by an equal number 
of Instruction Comprehension Program units and ten Question or 



procedures worked through the same material with the aid of a black- 
board and workbooks, wprd-cards, etc., specially constructed for the 
purpose. 

Two differing replications of the experiment were carried out 
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during an eight-week summer term* The'children ih School T were 
fairly representative of such a school population (Peabody Picture 
VocabtalM7 Test IQ mean ioi. Range 61-127). With few exceptions, 
they had hadno kindergarten experience 4nd took part in the experi- 
ment just prior tq> their entry into the first grade. Those in School H 
had completed one year of kindergarten and had been assigned to a 
special pre-reading class gather than to die first grade on the basis of 
teachets* judgments and readiness tests (Binet IQ mean 84, Range 



Pre- Reading Test, whfch was administered to all children in the ex- 

t, npne was ready 
to the groups 



listed in Table 9. 
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Table 9 Description of experimental conditions 



Croup 


Condittont 


N 




r 

V 




* 


(Daily for six wtikt) 


- School T 
Initial Final 


School H 
Initial Final 


PrPr: 


Two zs-minute pro- 
gramed tutoring 

aeaaiona 

# 


7 


7 


10 


8 


Pr: 


. One is-mlnute pro- 
gramed tutoring 
eesaion 






10 


10 


PlCl: 


One ig-minute pro- 
gramed tutoring 
eetslon and one 
30-minute class- 
room section 


7 


3 


10 


6 


Cl: 


One 30-minute dass- 
v room seasioh 


• 




10 


10 


C 1 C 1 : 


Two 30-minute data- 
room aefakma 


7 


5 


10 


7 


Control: 
• • 


No tutoring or 
dasaroom aeaaiona 


7 


7 


— 


— 






were in 
ac- 



tivities with the one exception that no printed words or letters woe to 
be presented. Violation of this rule occurred only in the case of moving 
picture film tides. 6 
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No difficulties were encountered in adii^stering .the Com- 1 
prehension Programs, and, except for slight changes' in the mechanics 
of presenting the material, no alterations have since been made in 



/ 



their reading appeared somewhat legs mechanical; and, in one in- 
stance, a child himself identified the critical point by saying the 
equivalent of “Aha, now I know what you want me todo 1” 



io, are of two kinds: learning data obtained during teaching and tu- 
toring sessions? and data obtained, from pre- and post-tests. 



■ ‘r* ■ 



Table to Mean post-test scores and gains 











Group 






Mtatun v 


School 


PrPr 


Pr 


- PrCI 


Cl 


CICl 


Control 


Gates Genl 


H 


1.0 


0.3 


1.2 


04 


* 0.3 




Vocabulary 


T * 


1.1 


— 


1.0 


— 


0.6 


o ' 


Test 


Mean 


1.1 


0.3 


14 


0.1 


0.4 


0 


GinnPrer 


H 






• MM* 




_ ’ 


_ 


reading Gain 


T ' 


7.7 


— 


19.3 


— 


9.6 


5.6 


Program 


H 


14.8 


7.1 


23.3 


9.5 


14.0 




Vocabulary 


T 


114 


— 


17.0 


— 


18.2 


.4 


Test Gain 


Mean 


13.2 


7.1 


212 


9.5 


15.8 


4 


Comprehension 


H 


11 J 


Ul 

S* 


9.7 


6.3 1 


7.3 


— 


Score 


^ w 


12.4 


— 


11.7; 


— 


11.6 


1.3 


(Post-test only) 


Mean 


12.1 


5.7 


10.3 


6.3 


9.1 


1.3 


Total Program 


H 


61.6 


15.6 


9.2 


11.0 


11.0 




Units’* 


T 


69.3 


— 


31.3 


— 


28.0 




Read 


Mean 


65.2 


15.6 


20.7 


11.0 


18.1 




Mean Rata 


H 


1.50 


.49 


1.12 


.44 


.22 




(Units per 
Sasshnf) 


T 

*■ Mean 


1.64 

1.56 


.49 


1.89 

1.37 


.44 


.56 

.36 




Pinal N 


H 


8 


10 


6 


io . 


7 


i 




T 


7 


— 


3 


— 


5 


7 




Total 


15 


10 


9 


10 


12 


7 



• In drift experiment program units in the Sight-reading Program were single 
sentences. 

* 

For tutored students, detailed individual records of progress 



are means based on the teachers* reports of the portion of the program 
(text) completed by the final session of teaching. Rates for classroom 
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present on 25. of the 30 teaching days; for tutored children) rates were 
based oh the number of sessions each child was present. 

* * The tutored gfoups consistently read more units of text than 
the comparable classroom groups. Note that if teaching time is con- 





in Tabje 10. As might be expected, children tutored twice daily com- * 
plefed more units of program content than those tutored once daily. 
Rates (units per session) are also higher for the PrPr groups but <lif- * 
ferences in rate are not statistically significant. There is a marked 
children in 




, which 



, „ / A — * - mqymmiv fTMAVU 

shows individual curves for the PrPr group (-solid lines only ) and a 
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• Pr FOLLOW-UP 

• ad SUMMER 



100 




40 50 00 

SESSIONS 



;• . — — /> with post-experiment follow* 

up, ana estimated maximum , performance curve for the group taught twice 
'daily in the daaftroom. Experiment vm. 
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constructed me ( an curve for the C1C1 group at School T. It should be 




cates; a few read less. Three children in the tutored group read less 
than the classroom maximum : one somewhat more, and three read 



toon) procedure enforced conformity to a norm, to the disadvantage of 
the faster learners. 

A question arose concerning the performance of the slower 



die. available material. Beginning approximately one month after 



his parents' requestrhecause of illness. The results of this follow-up, 
shown as dotted lines in Figure 4, indicate that with continued tutor- 



the faster learners. This outcome was encouraging, but further re- 
search is necessary for an adequate interpretation, the number of 



eluded. Further, at least three conditions changed between the experi- 
ment proper and the follow-up: the number of daily sessions, the 
environment in whidi tutoring occurred, and the nature of the con- 
current classroom instruction. 




performance during tutoring and on subsequent tests-the correlation 
is far from perfect. Vocabulary and comprehension scores on post- 
tests are considerably below what would be expected if the children 
had retained all of the learning they had demonstrated in the tutoring 
and classroom sessions; only in the case of the Comprehension Test is 
there much consistency between test scores and the amount, of ma- 
terial covered during teaching sessions. 

Gains on the general vocabulary, test are small and inter- 
group differences are negligible. This is to be expected from admin- 



ing by the sight-reading method. This test was included only as a 
precaution, to catch the occasional six-year-old with a large reading 
vocabulary. So far none have been caught. Gains on tests of reading 
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room procedures. These results agree with those of Experiment iv in 

favorincr ft comhiiuifinn nf PvAffHAtM/iJ j _i , . « 




ing. lugemer wim eviaence obtained in other experiments of this 
series, the results also suggest that teaching a child to rea$ provides 
excellent training in the skills required by reading-readiness tests. Al- 
though differences are not statistically significant,' the high Scores oIk 
tained on the Comprehension Test by the PrPr groups confirmed a 

favorable impression of the effectiveness of the Comprehension 
Programs. * ‘ 






EXPERIMENT IX .v . 

• < r ' . ^ 

Tryout of a word analysis program - 

In the experiments reported so far, which were brief and in- 
volved tutoring at only the earliest stages of reading, sigiit-reading 
methods were found to be satisfactory. However, since these methods 

may yin* kp flip rnncf offininn* p AW i ,/ _ 



,in English and since, in any case, there is a strong public prejudice 
* against their exclusive use, word <malysis dr phonics programs were 
deve loped.. The pur pose, of Experiment ix was to |ry out a first prog ram 
of this kind and, in accord with previous practice, it was tested under 
several conditions. 



concern- 



“ Jt MT ^ w* ^ w lUviivv lUlv 9 JlwA UUC JCil 1 cf H 1 Sil JjqJI* 

guage and their utility. A superficial search uncovered nearly three 
hundred rules. All of these may be necessary to ensure proper pro- 
nunciation (and spelling) of English words in printout even these are 
not sufficient. In any case, proper pronunciation is not the primary 
object of using grapheme-phoneme correspondences in the teaching 
of reading. Given printed or written words, preferably in context, the 
beginning reader learns implicitly or explicitly to use some of the rules 



can 



are in 



his oral or aural vocabulary. For this purpose, some rules are more 

t, a small 



* English words. 
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It is desirable fpr teaching to order the grapheme-phoneme 
“ J Hice rules in terms of their iitllity and regularity. A useful 
„ / «n this topic assembled by Carrol (1963) includes the 

work of Clymer (1963), who has done the most systematic work on 
utility^ and other references (Hanna & jacks, 1962; Venezky, 19^2). 
The latter indicates that similar but more extensive investigations 
utilizing computers are under way, but this work isf not yet complete, 
t The Word Analysis Program, like most phonics-oriented reading texts,* 
wasi based on an Arbitrary selection of rules influenced by a general 
knowledge of their utility. - ' 




- — ^ f w - - j - 

dee of rules for pronunciation of eight consonants in initial and 
terminal positions and five voxels, short sound only, in CVC trigrams, 
the operational program began with a test step in which a presumably 
new word was presented as a problem that could be solved by correct , 
pronunciation. Succqgs was reinforced and followed by presentation 
of. the next problem word. Failure was followed by cumulative preseh- 

tfltioil' nip fullllHnndl itifrtvivi o fiAi. 4v% 4 >Iia — ^1 i'_ . 




re- 



quired to solve the problem, i.e,i to read the problem word. These words 
were already kfiown or were taught or reviewed by a form of the Paired 
Associates Program. Successive increments of information were alter- 
nated with furthertest stepSi After continued failure, the tutor required 
the child to read the word by means of a forced multiple choice pro- 
cedure and then proceeded to the next problem. The unsolved prob- 
lem was presented again later. This portion of the program was sys- 

- * ^ - « - ■ " ' • - ^ • m % • . V m ~ am _ ^ 

, etc.. 




W ■* 4 ^ »^*v*** Vl VAUOi 

The operational program just described exemplifies a tech- 
nique called brightening or reverse fading. It is the inverse of the now 
common programing procedure, fading, in which a stimulus definitely 
adequate to evoke the required response is presented and then gradu- 
ally diminished until only a previously inadequate stimulus, e.g., the 
problem, remains. Brightening, on the other hand, begins with a pre- 
sumably inadequate stimulus, the test or problem, and adds increments 
of stimulation or information until the appropriate response occurs. 
In a sense, all program branches and branched programs are examples 
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of information as are necessary j and terminate when the learner dis- 
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covers the correct response, .The stimulus-response paradigm for 
brightening, it may be noted, is an abstract description of the 
"discovery method” currently being recommended for classroom 
’teaching. 1 




of cliildrejn were similar to those of Experiment’ vm. Two gtoups.of 
children were 'assigned randomly and tutored in two 15-minute ses- 
sions daily for six' weeks. As the experiment was planned, treatments 



The first session each day in Group A was devoted to Sight-reading and 
Comprehension Programs as in Group Pr of Experiment vm; in the 
second session the Word Analysis Program was presented. In Group B, 
tutored- twice daily, sections of the Word Analysis Program each fol- 
lowed the completion of a g- or 10-sentence story taught with the 




■ t: 



ix was 



jp " w ■ ■ <A4% If (Aw 

a failure, although in other respects it was.one of the most valuable in 
the series. After relatively ’few tutoring sessions it became apparent 
that most of the children were not prepared for the Word Analysis 
Program and that the experiment as too short to include both prep- 
aration and sufficient time on the program to evaluate it. The reaction 
of many children was generally negative and in some cases hostility 

5. For these reasons. 




of the availability of the children to test informally a number of varia- 

aL ^ a a. !• - ' _ 1 a « .. _ 




sis Programs. 




sis Program without difficulty. The quantitative results indicate that 

M V . ^ A' fln At a B Ak 

i was retained 



children, an tumw; ucn juugiow is uemg constructed. t nang es were 
also made in the Sight-reading Program. One, of some importance, 
had the effect of further reducing repetition of material already 
learned. The original program repeatedly presented every sentence in 
a 9- or 10-sentence story until all were read correctly in succession; the 
revised program omitted sentences once they were read correctly until 
the last remaining sentence in a story was read correctly, after which 
all sentences were re-presented. This procedure was repeated until all 
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sentences were read correctly and consecutively in a single re- 
presentation. 

u procedure imposes very strict conditions for progress 

through a book or content program. It is, in effect, a criterion of per- 
fection-the child must read nine or ten sentences consecutiyely with- 
put error. The program provided for one exception : when a single error 
was repeated a (precisely specified) number of times, the program was 
continued as though thp error had not occurred. Such exceptions, 
labelled with obvious implications as “blocks," were very rare and in 

t. This 




to require errorless reading of io to ra pages, but after careful observa- 




EXPERIMENT X. ' 

A preliminary field test of program tutoring 
as a supplement to classroom teaching 



the specific content of the tutoring programs used in these experi- 
ments. In some cases, the tutored children were not in school or not 
being taught to read; in others, the tutoring content programs were 
^independent of the concurrent school curriculum; and, in still other 
cases (specifically Experiments iv, V, and vn), the classroom was 




. However, in Ex- 

f — r *w 6 *«M* wxiiciK| cAvcpt xor worn analysis, was deter- 

mined by the reading curriculum of the school system in which the 
experiment was done. The operations of the Sight-reading and Com- 
prehension Programs were applied to the content program defined by 
the Pre-primers, Primer, and First Reader of the Ginn Basic Reader 
Series (D. H. Russell et al., 1961 ), S 

^ experiment compared the performance of two groups 
during the first semester of -the first grade. Their performance was 
measured primarily by published tests designed for use with the basic 
readers. All of the children had had kindergarten experience. None 
were repeating the first grade. The experimental group was a class of 

39; 34 remained through the post-tests given at the end of the semester. 
Tllfi control wnnn ftrnm (Vkini AfVkA« i ii, ^ gjjjjg school 
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contained 34 children post-matched individually on the reading 'score 
of the Metropolitan Readiness Test (given by the teachirs at the begin- 
ning of the semester). In postinatching, control subjects were selected 
‘ f^pm a poolsof children* who had been given the ^necessary pre- and 
post-tests to match the experimental subjects remaining when the ex- 
periment ended. In the control classrooms no changes were introduced 
in customary teaching procedures except to tell the teachers involved 
about the experiment, that the reading performance of. their pupils 
wouldj^e compared with that of the experimental group at the end of 
the semester, and to provide them with alternative forms of the post- 
tests to be used for practioe with the kinds of items included. Condi- 
tions in the experimental group classroom were as similar as possible 
to those in the control group except that during the morning hours 
. child was taken out of the classroom for two 15-minute tutoring 

sessions per day. The two sessions were separated by at least one hour 
and iyere so scheduled thattthey ordinarily occurred at times when the 
> chjQd would have been working individually on reading. Thus, the tu- 
toring supplemented, rather than replaced the teacher’s instruction in 
reading. Since eight to ten children were out at one time, the number 
of children remaining in the classroom was approximately the same 
as in the control classrooms which had smaller enrollments. Tutoring 
was continued for 12 weeks, preceded and followed by testing periods. 

Since this experiment was considered to be a field-test in 
which administrative questions were important, it should be mentioned 
that the tutors were housewives, most with children hi school, recruited 
through an announcement in the PTA newsletter at the beginning of 
the year, and paid at the rate of $1.50 an hour. All had completed high 
school, some had college work, butnone was a trained teacher. Sev- 
eral were sufficiently interested by their tutoring experience that they 
are planning to become teachers. / 

The tutors were given approximately 12 hours of .training in 
addition to supervision of their work^gfter the experiment began. A 
Tutors Guide was provided which desmoed the general pattern and 
K \ roles followed in all programs, the nature of each program, arid de- 

\ tailed procedures for each step in tutoring and for recording. Testing 

procedures and the Sight-reading Program were taught by means of 
\ reading, lectures, demonstrations, and practice on other tutors in two 
. \ three-hour meetings before the experiment began. The Comprehension 

\ and Word Analysis programs were taught in two subsequent three- 
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hour sessions. This training seemed to be sufficient when, supple- 
mented by careful supervision/ although some difficulty was en- 
countered with recording procedures which were more detailed than 
would normally be required for tutoring alone. It is the investigators! 
impression that conscientious adults with more limited^ educational 
background— or even children— coiild be trained as tutors if the record- » 



During\a three-week period between the last tutoring session 
and the end of me 



to ten children, b] the same tests administered individually by the 
tutors, and c] a specially constructed Word Recall Test. This latter 
test, administered individually, was similar to me Word Recognition 
sub-test of the Ginn Test, but required oral sight-reading rather man 
multiple choice responses. A comparison of me performance of me 
experimental and control groups on these tests and on me reading 
readiness test used for matching is shown in Table 11. The Total Ginn 



$ able it Comparison of groups on me matching variables and 
f reading achievement test scores 







Mean Score c 


> 




Mea$ure$ 


- Experimental 


Control 


t 


P 


Metropolitan Readiness 
Teat, Reading Score 
(Matching Variable) 


48.5 


47.3 


.84 


>.05 


Total Ginn Score 


168.4 


151.4 


2.22 


<.05 


Total Word Analysis 
Score v 


44.5 


38.5 


2.32 


<05 


Word Recall Score 


13.2 


10.6 


4.06 


<.01 



Score is the sum of me scores on me individual and group administra- 
tion of 'me Pre-primer and Primer tests; me Total Word Analysis 
Score is me sum of me scores on me two administrations of the Initial 
Consonant and Rhyming sub-test scores "on me Ginn Primer, Test; and 
me Word Recall Score is based on a single administration of me Word 
Recall Test, which included 15 words selected randomly from the Ginn 
Primer vocabulary, excluding words on the Word Recognition sub-test. 
In all three measures of reading performance, scores are significantly 
higher for me experimental group. 
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the slower readers. This fact was recognized by the teacher of the 
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B. TOTAL WORD ANALYSIS TEST SCORES 
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nG. 5.iDiatribution of scores on a general' reading test, a word analysis test, 
and a word recall (sight-reading) test for experimental and control 
groups. Experiment x. J 
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experimental group who reported shortly before the tests were admin-' 
istered that in the same class without tutoring she would have expected 
about ten failures; instead, there were four and their performance was 
more nearly satisfactory than ordinarily would have been expected. 
This description is almost perfectly reflected in Figure 6 which shows 
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PROGRAM SECTIONS COMPLETED IN CLASSROOM 

wg. 6. Reading progress of experimental and control group chil- 
dren in their respective classrooms at the end of the se- 
mester as reported by their teachers. Experiment x. 

the progress made in' reading in the classrooms by both groups as re- 
ported by the teachers at die end of the semester for children in the 
experimental and control groups. 

There is some indication in Figure 5 that the performance of 
faster readers was also improved by the tutoring but, unfortunately, 
neither the Ginn Tests nor the Word Recall Test was adequate to dis- 

1. In all three measures 
score. 

Experiment x also provided additional information concern- 
ing the effectiveness of the Word Analysis Program. Table 12 shows 



techniques by ten children who completed five or more sections of this 



favorably to this program, it is apparently an effective teaching device. 

The data presented so far suggest strongly that programed 
tutqring is an effective supplement to classroom teaching, but this con- 
clusion may be questioned since teacher variability was not properly 



V 












S#cKofft 




' 


2 


. 2 


3 


4 


5 e 


Number of 
Problems 


3 


3 


4 


8 


8 — 


Proportion 

Correct 


.20 


.37 


.65 


to 


.79 — 



controlled. An extensive study including a more adequate sample of 
teachers is being planned. 



.of programed tutoring as a research instrument. For this purpose a 
j ^ of Figures 7A a 
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vidual learning curves for the ten children in the experimental group 
who differed most from each other in the amount of programed ma- 
terial completed during the semester. Units on the ordinate, are arbi- 
trarily Specified sections in the programed sequence; units on the 
abscissa afce tutoring sessions at which a child was present. The pro- 



ciates Program, -followed, with some variation, by a series of cycles, 
each be^hteng with a ten-unit section of the Sight-reading Program, 
followecl by three sections of Comprehension Programs, and, begin- 
ning with the second cycle, by one section of the Word Analysis Pro- 



of the 



process of learning to read may be, it is highly determined— when the 
Conditions of learning are controlled in detail the learning behavior 
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process in a teaching situation (which programed instruction tech- 
niques make possible) can make significant contributions to the tech- 
nology of teaching. 

The data represented in figure 7 A may be used for this pur- 
pose. Although the pattern is similar for all children, there are varia- 
tions in overall rate-some of the children learn far more slowly than 
others. One might wish to attribute these differences to pre-experimen- 
tal factors beyond the experimenter’s control, but there is evidence that 
some, of the variation in performance can be attributed to the experi- 
mented conditions. The largest differences between the children’s rate 
of progress develop in the second section of the Sight-reading Program, 
Section 6 (see Appendix 1). Examination of the content program and 
consultation with tutors suggested that some children had difficulty in 
completing the section because of a change in the length of the unit 
(for a definition of a unit, see Appendix 1). At the beginning of Section 
6 the units sharply increase in size from two short lines to seven or 
eight longer lines-a unit here being the amount of material on a page 
in the first two Ginn Pre-primers respectively. The difficulty, however, 
cannot be attributed solely to the size of the unit since it does not occur 
in reading the third Pre-primer or in later sections of the Sight-reading 
Program in which units are even larger. , 

^ When the large individual differences associated with Section 
6 are excluded, as in Figure 78*. the uniformity of pattern becomes 
even more apparent, blit small individual differences still remain. 
These are associated almost entirely with Program Sections 11, 12, 17, 
18, 22., 28, and 33. Of these. Section 11 is the beginning of the Word 
Analysis Program, Section 18 is the beginning of the Story Compre- 
hension Program, and the remainder are sections of the Sight-reading 
program. On the assumption that any teaching procedure is defective 
if it makes progress difficult for some children, these sections need 
further attention. 

Figure 8 compares the progress of alTchildren in the experi- 
mental group in their classroom reading groups and in their tutoring 
sessions. Classroom progress was determined from teachers* reports of 
book and page completed by each classroom reading group; compara- 
ble data for tutoring progress was obtained from records of the investi- 
gators. Atthe end of the semester the slower readers had read as much 
material in the tutoring sessions as in their respective classroom read- 
ing groups; the faster readers had covered less fa tutoring sessions 
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than in their classroom reading .groups. Is this discrepancy good or 
bad? Is die classroom progress based on superficial coverage? Is the 
tutoring holding children back unnecessarily? Answers to these and,; 
similar questions are complex, but they can be obtained with further 
empirical research. 
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no. 8. Comparison of progress in reading in the classroom and in 
tutoring sessions. Experiment x. 



Summary of experiments 

Experiment ij showed relatively rapid acquisition of a reading 
vocabulary by retardeld children taught with a simple paired associ- 
ates program. 

Experiment n showed that retarded children, using a simple 
tutoring program, could teqch reading vocabulary effectively. 

Experiment m indicated practical effectiveness of a sight- 
reading program that taught reading vocabulary in a sentence context 



: x v -.. . .**■ 

K-lt... . -.V : ’?». 7]' . ‘ i'i'' rffi 

fc%; 

V-W-'H A-V. -t • 

E* ■ v I-.'; ' ^ 

v^. ■ « ; 

,\ v . . v... / ' •' 










He m ’ 



» - £ - 7 * ’ . **’'«♦ «*^PPv ■’"r.VV-'’- ; . *<< .. . t - •'; ■•■•'.’•»;*' ;. * , . v • - 

t^ ^ ^^^ j^ /Vj : ij,'^.v- ' •• .’ ■ ;,_»*.^ ] f /r-'*-f&>’^'\ : '\ '• . >W ,"H* * .'?.: :?>•;■; * ’ "• ’*'"• . '■* 

• . '-> V ■•+<; •y.v '•V.-.A'.’ ,->.•;••• . ' v*. k .f'V- : ,V" "" ' - ' v< - . ' 

$s^l%&&*VVr~ f \v.v. :, - :• - - : ' •• • -•' ■ 

aflaft&S^L* •' S > : ' V •• ;"v *• , ‘V'v/ • ; ' •"' 

- -7.: ' - - ' - 

>%:■■ . ■ ': • " '•''• • ' „;. ••": 
ite. ;*"• v ' '•;■ •• . •'•• ./$ .- 

,.,V \ '<Vv.'/ V : v :' : ". / ’ ■ . • 






•V .. V iV;y , . -• .** -'■> : '< < 

Y ' ■-• •".* • " V ,*. ■ V ;,: • ••,: .,- • ‘;3 iX 5 



• ;. AV 



— *• . ..• ••# ■" . 

A 1 -* 

• I . ‘ 



/ \Y 






':■: ,: -r--. •’-, ,. *»%;?*,. i;.-f • . J- 

* : '\ ‘ > ** *' k .- : '•’•■./. ■• >•’ 



••• , i .'l: , c ‘ 




• "* r 



■>. 



f. 









i 



;. -jM 



• ii i riia-w ii ii i ri^wiig ii f nrTi rfm i 



READING RESEARCH QUARTERLY • FaU 2965 



was obtained. 




. First 



tion with standard classroom teaching was more effective than class- 
room teaching alone, and probably more effective than programed tu- 
toring alone. 

Experiment v indicated that frequent (approximately daily) 
alternation of programed tutoring and classroom teaching was more 

effective than less frequent alten^ation. 

Experiment vi, using a paired-associates program, showed an 
inverse linear relationship between proportion of reinforcement and 
• fate of acquisition of reading vocabulary, indicating that the occur- 
rence of errors is not necessarily undesirable. 

/ l Experiment vn demonstrated effectiveness of a revised, sight- 
reading program for teaching reading vocabulary to older retardates, 
slow readers, and some young retardates beginning reading instruc- 
tion. Failure or very limited success was attained with other young 



retardates. 

Experiment vra showed practical effectiveness 'for a public- 




ing or classroom teaching was small, but that it was greater in the 
cas^ of a combination of the two techniques. Evidence suggested that 
with continued tutoring slower readers attain rates comparable to 
those of faster learners. 

Experiment ix was a tryout of a word analysis program that * 
indicated defects needing revision. ^ 

Fbcperiment x was a field test of a composite sight-reading. 




ness as a supplement to classroom teaching. Evidence was obtained ' 
for importance of details of the teaching process in determining the 
child’s rate of learning a complex skill, namely, reading. 



Conclusions 

These conclusions are based on examination of individual 
performance records, on statistical analyses of the results of single 



error in the series of experiments as a whole. In most instances, the 

B AMk mb' * — -- ^ . _ _ V ^ 

; in some, the experimenters 
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simply report impressions or opinions that have been strengthened or 
.weakened by what has been observed, iri which case reservations are 
indicated. The doubtful conclusions are often of greatest interest, and 
it is these that pose questions to be answered by further research. 

Conclusions supported by statistical evidence include die ob- 
vious one that programed tutoring does teach. Combinations of pro- 
gramed tutoring with classroom teaching are more effective than 
classroom reaching alone; and, almost certainly, although the evi- 
dence is less clear, more effective than programed tutoring alone. In 
combining the two techniques there is an Optimum frequency of alter- 
nation which, at the moment, is believed to be near once daily. In 
addition to teaching, there can be a “therapeutic” effect-programed 
tutoring reinstates effects of earlier learning or exposure to earlier 
teaching that are not otherwise apparent in the behavior of the chil- 
dren involved. In the programed tutoring situation children demon- 
. strate abilities that they do not show in the classroom. There is some 
evidence, limited to a few cases, that the favorable effects can extend 
to attitudes and behavior outside the classroom. 

Therefore large and' significant differences in the mean rates 

ait which' children of different chronological agfes, educational history, 
and other characteristics learn to read with programed tutoring. There 
are also individual differences, to the extent that there is overlap be- 
tween the fastest and slowest groups tutored, but these differences are 
larger at the beginning of tutoring than later. There is some evidence 
that after an initial period of varying length in which individual dif- 
ferences are prominent, most children come to leam at about the same 
rate as the faster learners. With the exception of a few severely re- 
tarded children (2-3 per cent of a sample heavily weighted with 
retarded children )* there have been no failures. With these exceptions, 
the more than 400 children tutored have learned to sight-read and, 
when this was required by the program, demonstrated comprehension 
of what they had read. The case is not yet complete, but there is reason * 
to doubt the currently conimon belief that many children fail to read 
for physical reasons, and to suspect that many of these failures cah 
be attributed to conditions necessarily or unnecessarily associated with 
group teaching in the classroom or with pre-school enviro nment . 

Much has been learned, mostly through trial and error, about 

the technique of programed tutoring. This ranges from specific bits of 
know-how to more general information which may have application 
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to the torching of reading by any methqd. The programs described in 
this paper can be presented and recorded satisfactorily after about 12 
hours of training by tutors with a high school education. Surprisingly, 
it was found that changing tutors, which was done for all children 
during the eighth week in Experiment x, had no apparent effect either 
on the performance of the children or their reaction to the tutoring 
situation. It was known that tutors and details of their tutoring tech- 
niques differ— their behavior is not fully controlled by the programs— 
but so far no. significant effects of these differences have* been de- 
tected. The optimal duration of tutoring sessions app&irs to be fifteen 
minutes. Children’s attention can be maintained for tlis interval, and 
it permits scheduling three sessions per hour, allowing free time for 
necessary bookkeeping and miscellaneous interruptions. 

The fonn and sequence of programs have undergone progres- 
sive changes which have, usually occurred between, but sometimes 
wfihin, experiments. This evolution will almost certainly continue, 
although the overall program appears to be satisfactory from a prac- 
tical point of view (at least until the next experiment). Modifications 
introduced so far were remedies for rather obvious defects, but it seems 
likely that later changes in programs will require more refined justi- 
fication. \ 

Looking back over the series of experiments, many of the 
changes appear trends, some of which may continue. Pictures, which 
were important components of the first program, are disappearing or 
functioning with a few exceptions only as incidental illustrations Or 
entertainment breaks that provide time for recording between tutoring 
units. They may be necessary in classroom instruction where catching 
and maintaining the attention of children is critical, but this does not 
seem to he a serious problem in programed tutoring. Here pictures are 
more likely to distract or to provide cues for memorization, which pro- 
duces the appearance, but not die reality of reading. Pictures no ddubt 
have a useful function. However, except in comprehension programs, 
effective means of using them in prQgramed tutoring have not yet been 
developed; Another obvious trend is the progressive reduction of repe- 
tition. Experiment yi provided objective support for this kind of 
change, which hadroeen introduced in earlier studies on the basis of 
more intuitive evidence. The reduction of repetition has been accom- 
plished by a greater use of test steps 4 n which success is followed by 
presentation of new material or of a new problem. It might seem that 
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this change would eliminate the review of already learned material 
but ttfis is not quite the case. Review of old material occurs, but chiefly 
in new contexts. Another trend is the increased use of context. For 
example, the Sight-reading Program which teaches words in the con- 
text of sentences ^largely replacing the Paired Associates Program. 
A similar change is being introduced in the new Word Analysis 
Program. - 

Not only the form, but the sequence of programs is under- 
going change. Sight-reading appears to be a satisfactory introduction 
to reading without prior preparation. The Paired Associates Program 
is now used, if at all, only when it is desirable to teach a small special 



hension, the Comprehension Programs are moving forward in the se 
quence. Word Analysis, on the other hand, .seems to benefit from 
preparation in both sight-reading and comprehension, so that in the * 



sequence. 

/ Assuming that Programed Tutoring is a technique that can 
improve the teaching of elementary reading, how can it be most ef- 
fectively used for this purpose? The answer to this question involves 
administrative and economic as well as pedagogical considerations. In 
this regard, the term “tutoring” immediately raises the question of 
practicality, following the natural assumption that tutoring is an art 



tutoring one child at a time could improve on the results Obtained by 
group teaching in the classroom. The problem arises because enough 



ing even if it were economically feasible to use them in this way.\As 
Bertrand Russell (1926, p. 15) stated forty years ago: “However excel- 
lent might be the results of such a system, no man with a modem out- 
look would give it serious consideration because i£ is arithmetically 
impossible for every child to absorb the whole time of an adult tutor. 
The system is therefore one which can only be employed by a privi- 
leged caste; in a just world, its existence would be impossible.” As 
tutoring is traditionally viewed, it is, as Russell indicates, impractical 
for general use, but the use of Programed Tutoring, which incorporates 
some of the advantages of the tutoring System, is not similarly pre- 
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can be done efficiently by persons with training far short of that re- 
quired of professional teachers, and very likely by some whose educa- 
tional level does npt equip them today for other jobs. 

In its present form Programed Tutoring seems to function 
best as a supplement to classroom teaching. It needs modification if it 
is to be used effectively with severely retarded children. It is not yet 
certain whether the technique will be as useful with children who 
learn to read without difficulty in the public school classrooms as it is 
with those who do not. It is expected-in fact, in a few cases it has been 
found— that Programed Tutoring is useful in meeting the "drop-in” 
problem, the increasingly serious problem of children who change 
schools frequently and often do not bring with them adequate records 
of their previous classroom progress. Such children benefit especially 
from individual teaching. It is possible that Programed Tutoring may 
be adapted for remedial work with older children or for teaching spe- 
cial groups such as the deaf. These and similar questions concerning 
the best use of Programed Tutoring will require further research. 

The comments so far in this section have emphasized prac- 
tical aspects of Programed Tutoring which are relevant/to the first of 
the two goals; namely, the development of a practicaVtechnique that 
can improve the teaching of elementary reading. Although the tech- 
nique and the knowledge of how to use it can certainly be improved, 
this first goal has been achieved. 

: The second aim of this research was to develop an adequate 

instrument for research in problems of teaching* A number of writers 
have suggested that whether or not programed instruction techniques 
prove to be practical for routine teaching purposes, their potential con- 
tribution to educational research and to die development of a science 
of teaching is very great. For example, Stolurow states : 



* The main staying quality of programed instruction that will be 

recognized more and more is its capability of controlling conditions 
which heretofore it was not possible to' control. With programed instruc- 
tion and machines, it is possible td be quite explicit about either a method 
ora.teachlng sequence. Added to this advantage is that of reproducibility 
of the conditions. They make it possible to study teaching' itself in a 
way that we could not do in the past. Involved is, the possibility of doing 
research on methods independendy-of the teacher's personality; later on 
we can study the methods when combined with different personalities to 
determine what happens to their effectiveness. While there has been 
considerable interest in this problem in the past, up to now, the capabil- , 
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ity for studying it did not exist* Since it does now exist, the prediction is 
that we will see studies of how these two sets of variables interact with 
one another. This will make a science of teaching a genuine possibility. 

.. This leads to the next prediction that the teaching machine will 
contribute to a theory of leaching. As a research laboratory, the teaching 
ma ^“ ne has the potentiality of providing the' necessary controls for 
studying variables of teaching strategies, and so I predict that we? will 
see one or more theories of teaching emerge in the hear future with re- 
liable and valid data to support them. (1962,^. 251) 

The authors of this paper agree strongly with Stolurow’s point 
of view, although very little of his prophecy has yet come true. Pro- 
gramed instruction is new, and its practitioners and researchers have 
so far been more concerned with making it work and learning how 
to use it for practical purposes than in using it as a tool for research 
on broader questions. But the postponement can be justified. Pro- 
gramed instruction can be a useful research tool in the field of teach- 
ing only to the extent that it is developed as a full scale and effective 
teaching device. Laboratory miniatures must leave many real ques- 
tions unanswered and more extended investigations incorporating 
techniques that do not teach will be accepted only reluctantly and tem- 
porarily in working schools or even laboratory schools. It is for this 
reason that this research, aimed at developing Programed Tutoring as 
a rese^ch instrdmeot, has~for five yeaj:s emphasized poetical con- 
siderations and postponed more scientific questions. 

^ A turning point has now been reached. The concern with im- 
proving Programed Tutoring as a teaching device remains, but, its 
present value for this’ purpose is sufficiently clear that attention can 
be turned to its use as a technique for investigating other questions 
related to teaching. Forthis purpose, as Stolurow ahd others have sug- 
gested, it is well suited. Its most valuable characteristics as a. research ' 
instrument are two: it provides control and reproducibility of the con- 
ditions under which teaching is done; and it provides detailed and 
sensitive measures of the results. Experiment x gave an indication of 
the precision of both of these characteristics, the evidence being the 
close correlation between conditions,* defined by the programs, and de- 
tailed measures of learning for individual children. In effect, Pro- 
gramed Thtoring is a microscope that can be focused on die tea chin g 
process, and its use, whiph c&n be justified on more immediate utili- 
tarian grounds, can convert the classroom to an instrumental lab- 
oratory/ ; . . . * 
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APPENDIX I 

Surfimary of operational programs 



Tutoring are^jefined below: 



to Programed 



1 Unit: A sentence or sequence of sentences to which one cycle of an 

operational program (Paired Associates, Sight-reading or Comprehen- 
sion) is applied. In Experiment .x units in the 'Sight-rea^g Program 
increased in size from approximately »twb -lines in the first Hf-primer to 
a page of six to eight lines m the Primer.^ < ' 



Section: -a set of eight _ 

consecutively without* error before proceeding to the next one. 

' r : , •• ' •' - 4 ;. • . ' * :'■**» * 

Program Section: a division referred to in the text and this appendix 
which includes several Consecutive sections of sight-reading material but 



pnly one section of other programs. 



^ 1 Reinforcement: In Experiments 1 to vn; reinforcement was a brief 
flash of light. The learner was told that the light indicated he had read 
. a word or other unit correfctly: After Experiment vi, reinforcement took 
the form of verbal approval such as "Good,” "That’s right ” £tc. 



v Required, requires: a term implying that the tutor continues prompt- 

# ing Wthin^liinif S liv flm ...a: i 1.1.I Vi* 



behaves in the specified way, e.g., makes a choice or ihakes a correct 
choice. - •” 



Paired Associate Program (Verbal form) * 

; Materials consist of a deck of ten ,to sixteen 3 X 5 cards on 
each of which is printed one word. 

,* The following procedure is repeated for each word with the 
deck being shuffled between sections. . . 



Step 1: 



•- _ - — — 

If he reads it correctly, the tutor reinforces and proceeds to the next 

word. If he does not read it correctly, the tutor proceeds to Step 2. 

Step 2 : : The tutor shows tlie word> reads it aloiid, and requires the 
leamdr to repeat it, then proceeds to Step 3. 



one 



. - — - — — - — — - ^rr vjiv 

second, then re-presents it and aska the learner to read the word. If 
the learner reads it correctly,, the tutor reinforces and proceeds to tlie 
next word; Step 1. If he does not read it correctly, the tutor reads it, 
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requires the learner to repeat it, and then proceeds to the next word, 
1. ■ 



Sight-reading Program 

For the Sight-reading Program an alphabetized list is provided 



Step 1: ( Test Step ) The tutor shows the appropriate unit and says, 
“Can you read this sentence?’* If the unit is read correctly orally, the 
tutor reinforces and proceeds to the next unit, Step 1. If it is not read 
correctly , the tutor proceeds to Step 2. ' " * •: 



Step 2: ( Teaching Step)— repeated for each word missed in Step 1, 
in alphabetical order, a] The tutor points to the word in the word list 
and requires the learner to point to that word in the sentence, b] The 
tutor then asks the learner to read the word. If he reads it correctly, the 
tutor reinforces and proceeds to the next word. If the word is not read 
correctly, the tutor requires the learper to repeat it, then proceeds to 
the next word. After the final word* the tutor proceeds to Step 3. / 



Step 3; (Test Step) £>ame as Step 1 except that failure to read' 
correctly is followed by Step 4. 



Step 4: ( Teaching Step)— repeated for each word missed in Step 3 
in alphabetical order, a] The tutor reads the word aloud, indicates its 



to it. b ] Same as Step 2b except that it Ts followed by Step 5. 



Step 5: ( Test Step) Same as Step 1 except that failure to read cor- 
rectly is followed by Step 6. 



Step 6: (Teaching Step)— repeated for each word missed jg}. Step 5 
in the order of occurrence in the unit. The tutor points to the word, 
reads it, and requires the learner to repeat it. After the final word, the 
tutor proceeds to the next unit, Step 1. \ , 



Comprehension programs 

All comprehension programs (Instruction, Question, State- 
ment, Story, Completion^ and Logical) begin by requiring the learner 
to read one or more sentences, using the Sight-reading Program when 
necessary. This is followed by the first step of the Comprehension 
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hension Program summarized below is typical. 



' Statement comprehension program Materials for each unit of this 
program consist of a one-sentence statement, a question, and, under a 
flap, three words, phrases, or sentences, one of which is the correct an- 
swer to the, question. A picture may be presented with the restriction 
that it does not provide the answer to the question. Once the Statement 



1. 



Step 1: The learner is required to answer the question correctly. 
The tutor waits for an answer approximately five seconds after the 
question is read, and then uses the following prompts as necessary: 



1] “Read it again.” 

2] “Read it faster.” , 

3] “What does it say?” 

4] “Tell me the answer.? 7 ' 7 

jp “What is the answer?” 

6] “Answer the question.” 

7] “Look at the sentence again and then tell, me the answer.” 

8] The tutor answers the question, using a complete sentence, 
* and requires the learner to repeat it. .. 

When the learner gives a^correct answer, the tutor proceeds to Step 2. 



Step 2: The flap is raised and the learner is required to choose the 
correct answer and then to read it aloud, using the Sight-reading Pro- 
gram if this is necessary. \ 



Word analysis program 

The Word Analysis Program was designed to teach grapheme- 



Associates and Sight-reading Programs and arranged to provide the 
children with known or “clue” words. Problems were presented in 
which parts of the clue words could be selected and reassembled in 
order ^o read the unknown or “problem* words. Below is a sample 
Word Analysis problem. V ♦ 
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Clue Word$ 
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Problem Word . mug mug m 
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■ ^ the following procedure, if the learner reads the problem 

word correctly on any step, the tutor reinforces and proceeds to the 
next problem. : 



• n 

_ s ? e P I: The tutor asks the learner to read the problem word 
(Column i). If the problem word is not read correctly, the tutor pro- 
ceeds to Step 2. - ’ r 



Step 2: The learner sounds out and reads the clue words in 
Column fusing the Paired Associates Program if necessary, then pro- 



Step 3* The learner is asked to sound out and read the problem 
word at the bottom of Column 2. If the word is not read correctly the 
tutor proceeds to Step 4. , . 



Step 4; 




word in Column a, saying, “If this is X and this is Y, can you figure out 
this word?” If the word is not read correctly, the tutor proceeds to 



I- * . 

Step 5: Pointing to the clue words in Column 3 and then to the 
problem word, the tutor says, “If these words are X, Y, and Z, can you 
figure out this word?” If the problem word is not read correctly, the 
tutor repeats this step using Column 4. If the problem word is still not 
read, the tutor proceeds to Step 6. \ 



Step 6: The learner is taught to sound out the problem word fa . 

Column 4, using the Paired Associates Program, then proceeds to 
Step 7. ; r . 



■ ' ■;*% ... i 

Step 7: The tutor sounds out the problem word and says, “Now 
put the parts together and tell me the word ” If the problem word is 
still not read correctly, the tutor says the problem word and an alterna- 
tive word from which the learner is required to select and repeat the 
problem word. * 
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APPENDIX II 

Sequence of program sections 

Section . Operational Program • Content 

1. Paired Associates First ten words in Section 2 

2. Sight Reading Red Boofe (Ginn Pre-Primer #1) * 

3. Instruction Comprehension Based on Red Book 

4. Question Comprehension _ Based on Red Book 

5. Statement Comprehension Based on Red Book 

6. Sight Reading Green Book (Ginn Pre-Primer #2) 

7. Instruction Comprehension Based on Green Book 

8. Question Comprehension Based on Green Book ' 

9- Statement Comprehension Based on Green Book 

10. Paired Associates Ten words from Word Analysis Pro- 

gram/Sections 11, 16, 21 

11. Word Analysis, Part 1 p, s, t, i; letter names and 3 initial 

consonant problems * 

12. Sight Reading Blue Book (Ginn Pre-Primer #3) 

13. Instruction Comprehension Based on Blue Book 

14. Question Comprehension Based on Blue Book' 

15. Statement Comprehension Based on Blue Book 

16. Word Analysis, Part 2 b, d, m, o; letter names and 3 initial 

consonant problems 

17. Sight Reading The Little White House (Ginn Primer) 

pp. 6-30 > 

18. Story Comprehension Little White House, pp. 6-30 

19. Completion Comprehension Little White House, pp. 6-30 

20. Logical Comprehension Little White House, pp. 6-30 

- 21. Word Analysis, Part s g, n, a, e, ti; letter names and 4-ini- 

tial consonant problems 

22, Sight Reading j Little White House, pp. 32-58 

2 3 - Story Comprehension Little White House ? pp. 32—58 

' 24. Cpmpletion Comprehension Little White House, pp. 32-58 

25. Logical ConjprehensiQn Little White House, pp. 32-58 

26. Paired Associates 16 words from Word Analysis Pro- 

gram, Sections 27, 32, 37, 42, 47, 

, * . 52 ^ •• 

27. Word Analysis, Part 4 8 initial consonant problems 

28. Sight Reading Little White House, pp. 60-86 

29. Story Comprehension Little White House, pp. 60-86 

30. Completion Comprehension Little White House, pp. 60-86 

31- Logical Comprehension Little White House, pp. 60-86 

за. Word Analysis, Part 5 8 final consonant problems 

33 - Sight Reading Little White House, pp. 88-118 

34 - Story Comprehension Little White House, pp. 88-118 < 

35 - Completion Comprehension Little White House, pp. 88-118 

зб. Logical Comprehension Little White House, pp. 88-118 
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37- Word Analysis, Part 6 . 

38. Sight Reading 

39* Story Comprehension ' 

40. Completion Comprehension 

41. Logical Comprehension 

42. Word Analysis, Part 7 

. 43. Sight Reading 

44. Stdry Comprehension 

45. Completion Comprehension 

46. Logical Comprehension * 

47. Word Analysis, Part 8 

48. Sight Reading 

49* Story Comprehension 

50. • -CompHtion Comprehension 

51. Logical Comprehension 

52. Word Analysis, Part 9 
53* Sight Reading 

54- Sight Reading 

55- Sight Reading 



8 medial vowel problems 
Little White House, pp. 120-134 
Little White House, pp. 1 20-134 
Little White House, pp. 120— 134 
Little White House, pp. 120-134 
8 mixed CVC word analysis problems 
Little White House, pp. 136-164 
Little White House, pp. 136-164 
Little White House, pp. 136-164 
Little White House, pp. 136-164 
8 mixed CVC word analysis problems 
Little White House, pp. 165-182 
Little White House, pp. 165—182 
Little White House, pp. 165-182 
Little White House, pp. 165-182 
8 mixed CVC word analysis problems 
On Cherry Street, (Ginn First Reader) 

pp.5-14 *: 

On' Cherry Street, pp. 15-26 
On Cherry Street, pp. 27-34 
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